🕷️️ Job Radar • SCRAPING

upwork.com 🟠 2026-05-24

🔹 Production E-commerce Discount Crawler
👤 Client: ARE Member since 2026-01-06
💰 Price: ****
🚩 Problem: Need for automated daily extraction of promotional product data from multiple e-commerce stores into a centralized database.
📦 Existing: Store list, database schema, and credentials.

Specifications:

[Target] E-commerce stores with active promotions
[Method] Daily scheduled crawls
[Method] JavaScript rendering via Playwright
[Method] Proxy pool with automatic escalation (Standard to Residential)
[Stack] Python
[Stack] Supabase (REST API)
[Format] Product name, Brand, Current price, Original price, Discount %, Promo code, Stock status, Image URL, Product URL, Category, SKU/ID
[Format] Unique crawl run ID
[Format] Full raw JSON payload
[Security] Bot protection bypass
[UI/UX] Daily health reports (discovered, crawled, failed, blocked, proxy escalations)

Workflow:

1. Identification of stores with active promotions
2. Product extraction via Playwright and proxy rotation
3. Data insertion into Supabase via REST API
4. Generation of daily health report per store